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Abstract 

Multiobjective control design is known to be a difficult problem both in theory 
and practice. Our approach is to search for locally optimal solutions of a nonsmooth 
optimization problem that is built to incorporate minimization objectives and con- 
straints for multiple plants. We report on the success of this approach using our 
public-domain MATLAB toolbox HIFOO 2.0, comparing our results with benchmarks 
in the literature. 



1 Introduction 

Multiobjective control aims at designing a feedback control law meeting potentially con- 
flicting specifications defined on various input/output channels. 

In the context of linear systems, a standard approach to multiobjective contro l is the 
Lyapunov shaping paradigm proposed in the mid 1990s bv IScherer et al. f 19971 ). as an 
outgrowth of the LMI (linear matrix inequality) formalism of Boyd et al. f 19941 ). Within 
this scope, multiobjective controller design boils down to semidefmite programming (lin- 
ear programming over the cone of positive semidefmite matrices) provided all the closed- 
loop specifications are certified simultaneously by a unique quadratic Lyapunov function. 
Moreover, the controller is retrieved a posteriori via tedious linear algebra, and its order 
is equal to the order of the open-loop plant plus the order of the weighting functions, 
which can be quite high in practice, in contradiction with simplicity of implementability 
requirements of embedded control laws. Another computational approach to multiobjec- 
tive control explo its the parametrization of all stabilizing controllers described e.g. by 
Vidvasagarl (11985T). Linear progra mming can be used in this context to design controllers, 
see e.g. iBoyd and Barrattl (1199 IT ), but they are typically of very high order. 
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Following a decade of research efforts, these restrictions have been gradually relaxed (dis- 
tinct Lyapunov functions for distinct performance channels, parameter-dependent Lya- 
punov functions, decoupling between Lyapunov and controller variables, lower-order con- 
troller design) at the price of an increased computational burden. The ROMULOC (ro- 
bust multiobjective con trol) toolbox is a recent publ ic-domain matlab implementation 
of these techniques, see IPeaucelle and Arzelierl (120061 ). 



Particular cases of multiobjective robust control problems include strong stabilization 
(wher e a plant must be stabilized by a controller which is itself stable, see IVidyasagar 



(119851 )) or simultaneous stabilization (where a single controller must be found that stabi- 
lizes several plants, see iBlondel ( 1l994h ). Most of the algorithms or heuristics available to 
solve these problems also typically result in very high order controllers. 

In this paper, we introduce the new release 2.0 of our freely available package hifoo, which 
is aimed at removing the above mentioned limitations in the context of multiobjective 
controller design. First, the controller order is fixed at the outset, allowing for lower- 
order controller design. Second, no Lyapunov or lifting variables are introduced to deal 
with the conflicting specifications. The resulting optimization problem is formulated on 
the controller coefficients only, resulting in a typically small-dimensional, nonsmooth, 
nonconvex optimization problem that does not require the solution of any large convex 
subproblems, relieving the computational burden typical of Lyapunov LMI techniques. 
Because finding the global minimum of this optimization problem may be hard, we use 
an algorithm that searches only for local minima. While no guarantee can be made about 
the behaviour of this algorithm, in practice it is often possible to determine an acceptable 
controller quite efficiently. 



See also lApkarian et al.l (120081 ) for nonsmooth nonconvex optimization techniques applied 
to multiobjective robust control. As far as we know, no software implementation of these 
techniques is publicly available at present. 



2 Problem Formulation 



The ith generalized plant P % = (A\ B\C\ D l ) describes the state-space equations 

x\t) = AV(t) + B[w\t) + B l 2 u i {t), 
z \t) = Clx^^ + D^w^ + Di^it), 
y\t) = Clx\t) + D\ lW \t) + D* 22 u\t), 

where A 1 G K™' xral ; B\ 2 G W^ xni2 , D 21 G W P2Xm ^, with other matrices having compatible 
dimensions. The signals (z % ,w z ,y\u l ) respectively represent the regulated outputs, the 
exogenous inputs (including disturbance and commands), the measured (or sensor) inputs, 
and the control inputs. Let A" be the number of plants. 

The problem is to choose a single controller 

K=(A K ,B K ,C K ,D K ) 
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with state-space equations 



x K {t) = A K x K {t) + B K y(t), 
u(t) = C K x K (t) + D K y(t), 

where Ak G M nKXUK , with E>k,Ck, Dk having dimensions that are compatible with Ak 
and the generalized plant matrices. The controller order uk is fixed, so it can be specified 
by the designer. The Ti^ norm of the zth closed loop s ystem is the norm of the transfer 



function from input w % to output z l \ see IZhou et al.l (119961 ) for details. The complex 



stability radius is a useful alternative measure when no w l and z l performance channels 
are specified and hence the Tioo norm is not defined: for a stable closed loop system, this 
is the largest 2-norm perturbation to the closed loop system that can be tolerated while 
guaranteeing that the perturbed system remains stable. The spectral abscissa of a closed 
loop system is the largest of the real parts of its poles (eigenvalues). 

Let f3 j , j = 1, N each be a real number or oo, and consider the following optimization 
problem: 

min max Jgj(K) : = oo} (1) 

K j=l,...,N 

subject to j = l,2,...,N, (2) 

where each gj is one of the following supported functions of the closed-loop system for 
Pi , abbreviated by a single letter as follows: 



• 'h': Hoo norm (oo if unstable); 

• 'r': reciprocal of complex stability radius (oo if unstable); 

• ' s ' : spectral abscissa. 



The functions gj are all nonconvex, nonsmooth functions of the controller matrices. Thus, 
the optimization problem is potentially quite difficult. We focus on two scenarios. 

Scenario 1. All f3j = oo, and all gj are 's'. Thus the problem is to minimize the 
maximum of the real parts of the closed loop poles of all plants. This approach is suitable 
for simultaneous stabilization, as the goal is to move the poles as far left in the complex 
plane as possible (in the minmax sense). If the final objective value is negative, all closed 
loop plants are stable. 

Scenario 2. All (3j = oo, and all gj are 'h'. The problem is to stabilize all plants and 
minimize the maximum of the Tioo norms of the closed loop plants. The advantage over 
Scenario 1 is that the goal is to not only stabilize the plants, but also optimize their Ti^ 
performance (in the minmax sense). The disadvantage is that evaluating the Tioo norm 
repeatedly is more time-consuming than computing the spectral abssissa repeatedly, and 
I/O performance channels must be specified. 

These two scenarios are the ones for which benchmarking is done in Section [5j However, 
the interface to HIFOO is sufficiently flexible that there are many other alternative ways 
to call it which may be of interest to users. For example: 
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Alternative 3. All (3j = oo, and all gj are 'r ' . The problem is to stabilize all plants and 
maximize the minimum of the complex stability radii of the closed loop plants (minimize 
the maximum of their reciprocals). The advantage is that the complex stability radius is 
a more robust measure of stability than the spectral abscissa, so this is an appropriate 
alternative to Scenario 2 when I/O performance channels are not specified. 

Alternative 4. This is a more specific example. Suppose (3\ = oo, fa = 100, gi is 'h' 
and §2 is ' r ' . The problem is to stabilize both plants and minimize the Tioo norm of the 
first closed loop plant subject to the complex stability radius of the second being at least 
0.01. 

If one wishes to impose restrictions, such as stability, on the controller (so-called strong 
stabilization), it is possible to do so using the multiple-plant model above by defining 
a plant P % so that the closed loop plant is equivalent to the system described by the 
controller. However, we provide a more convenient way to specify controller stability 
directly, as described below. Benchma rks assessing the value of a previous version of 



hifoo for strong stabilization appear in iGumussoy et al.l (120081 ). 



3 Optimization method 

HIFOO 2.0 searches for local minimizers of flTJ-(j2]). The algorithm has two phases. In 
each phase the main workhorse is the BFGS optimiz ation algorithm, which is s urprisingly 



effective for nonconvex, nonsmooth optimization, see lLewis and Overton! (120091 ) . The user 
can provide an initial guess for the desired controller (see below); if this is not provided, 
hifoo generates randomly generated initial controllers, and even when an initial guess is 
provided, hifoo generates some additional randomly generated initial controllers in case 
they provide better results. 

The first phase is stabilization: BFGS is used to minimize the maximum of the spectral 
abscissae of the closed loop plants for which gj is either 'h' or 'r' . This process termi- 
nates as soon as a controller is found that stabilizes these plants, thus providing a starting 
point for which the objective function for the second phase is finite. 

The second phase is optimization: BFGS is used to look for a local minimizer of the 
following unconstrained problem: 

N 

mm F(K) + pJ2^(0,9j(K)-^), 

where F is the objective function defined in (pQ) and p is a positive penalty parameter 
multiplying the sum of the constraint violations. If BFGS is unable to find a point for 
which the constraint violations are zero, the penalty parameter p is increased and the 
optimization is repeated as needed (unless F is identically zero, that is all j3j are finite). 
Although there are no guarantees, very often this process is quite effe ctive and reasonably 



fast. By default, hifoo invokes the gradient sampling method of iBurke et al.l (120051 ) 
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after BFGS terminates, but this is generally more time consuming, and can be avoided 
as explained in the next section. 

4 User interface 

HIFOO is written in MATLAB. The simple call 

K = hifoo(P, order) 

looks for a controller K solving Scenario 2 above: stabilize the plants described by P and 
minimize the sum of the Tioo norms of the closed loop plants, using a controller of the 
specified order. Here P is a cell array of plants specified in any of several formats, typi- 
cally using the ss class of the matlab Control System Toolbox. A useful abbreviation 
is P{ j }= ' K ' , which specifies that the closed loop system for the j'th plant is the con- 
troller itself. If the order argument is omitted, the default order is used (static output 
feedback) . 

A more general calling sequence is 

[K, F, viol] = hifoo(P, order, init, fun, ... 
upperbnd, options) 

where P and order are as above, init is an initial guess for the controller (several formats 
are supported), fun is a string specifying the characters defining the supported functions 
gj (see Section [2]) or a single character if all gj are the same (default: 'h'), upperbnd is 
an array specifying the upper bounds (3j (default: all bounds set to oo), and options is 
a structure with various optional fields, some of which are described below. The order 
of the input arguments does not matter except that P must be first. The outputs are, 
in addition to the controller K, the value of the objective function F(K) in ([1]) and a 
vector of constraint violations max(0, gj(K) — f3j). There is a fourth output argument 
loc ("local optimality certificate") that can be requested if gradient sampling is used in 
addition to BFGS. 

Some of the more useful fields in options are: 

• options . cpumax: requests HIFOO to quit when the CPU time in seconds exceeds 
this quantity (default: oo) 

• options . fast: 1 to use a fast optimization method only (BFGS), to finish opti- 
mization with a slower method (gradient sampling, which may give a better answer) 
(default: 0, as long as quadprog is in the path; see below) 

• options .prtlevel: one of (no printing), 1 (minimal printing), 2 or 3 (more 
verbose) (default: 1) 



• options . struct: specifies sparsity structure to be imposed on the controller (see 
documentation for details) 

• options . weightNormK: weight for adding a penalty on the size of the controller to 
the objective function, specifically (||Afr-|| 2 + ||.Bk|| 2 + ||C^|| 2 + ||JDjf (I 2 ) 1 / 2 (default: 
0) 

• options . augmentHinf : weight for adding the reciprocal of the complex stability ra- 
dius to the Tioo norm to avoid closed loop plants that are only marginally stabilized: 
applies to all plants for which gj is 'h' (default: 0) 



hifoo 2.0 uses the following external software: 



• required: HANSO 1.0, a hybrid algorithm for nonsmooth optimization, freely avail- 
able from the hifoo web page; 

• required: the matlab Control System Toolbox, for Ti^, norm and complex stability 
radius computation; this also provides user-friendly system modeling with the ss 
class; 

• optional: quadprog from either the MATLAB Optimization Toolbox or MOSEK; 
needed only by the gradient sampling part of the algorithm, which is not required. 



5 Benchmarks 



We consider a number of simultaneous stabilization problems from the literature; in each 
case we wish to stabilize multiple plants with a single controller. We consider both 
Scenario 1 (optimizing the spectral abscissa, by a call such as K = hifoo (P, ' s ; ,n), 
where n is the order of the controller), and Scenario 2 (optimizing Ti^ performance, by a 
call such as K = hifoo(P, 'h' ,n), or equivalently K = hifoo (P,n)). Notice that we do 
not need to explicitly set the upper bounds to oo, since that is the default value. 

The following matlab sc ript illustrates the process , using Scenario 1. There are three 



-P- 

first-order plants, given in lJia and Ackermannl (120011 ). and we wish to stabilize them with 
a first-order controller: 



» P = {ss(tf([2 -9] , [1 -8.8])), ... 

ss(tf([l 2],[1 -6])), ... 

ss(tf([2.5 6],[1 -8]))}; 
» K = hifoo(P, 's' ,1) ; 

hifoo: best order 1 controller found 
has spectral abscissa -0.284216 

» tf(K) 



Transfer function: 
s + 1.182 



s + 1.595 

» eig(feedback(P{l},-K)) 
ans = 

-0.2842 + 1.8223i 
-0.2842 - 1.8223i 
» eig(feedback(P{2},-K)) 
ans = 

1.0e+009 * 
-4.5265 
-0.0000 
» eig(feedback(P{3},-K)) 
ans = 

-9.7628 
-1.4768 



Note that a third-order controller was designed in |Jia and Ackermannl (120011 ) . 



The output of hifoo may differ on different runs since the initialization is done randomly. 
However, the output from one run may be used to initialize a second run on the same 
problem; the result cannot be worse. For example, following the run above with 

» K = hifoo(P,K, 's' ,1) ; 

results in 



hifoo: best order 1 controller found 
has spectral abscissa -0.286524 

which is a slight improvement. Depending on the problem and the initial randomization, 
several successive calls to hifoo may be required to obtain a stabilizing controller. 

We have collected various academic and application examples. We now give benchmark 
results for Scenarios 1 and 2. 



5.1 Scenario 1: Simultaneous Stabilization 

To evaluate hifoo, we consider 31 benchmark problems for simultaneous stabilization 
as shown in Table [TJ There are 11 problems from applications and 20 academic test 
problems. The benchmark problems include dynamic, state-feedback and static-output 
feedback controllers. 
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Problem Name 


N x (n max , m 2 ,p 2 ) Known HIFOO 


CRJ-200 Aircraft 




6 x (6,1,6) 








F4E Fighter Aircraft 




4 x (3,1,3) 








Gas Turbine Engine 




2 x (10,2,5) 








Helicopter Toy 




4 x (3,1,1) 


2 


1 


Lane-Keeping of AV 




3 x (2,1,1) 


4 

4 


1 


Oblique Wing Aircraft 




04 X (4, 1,1) 


n 
U 


U 


r r 1 \_j 




6 x (4,2,4) 


n 
U 


U 


T3TTA/T1 A 
rtrilvll4 




4 X (8,4,4) 


ZD 


n 
U 


Servomotor 




4 x (2, 1, 1) 


1 


1 


Ship-Steering 




2 x (3, 1,3) 








burred- lank Keactor 




3 x (2,1,1) 








Arehart-Wolovich 




3 x (2,1,1) 


1 


1 


Bhattacharyya et ai, Ex. 


1-1 


16 x (3,1,1) 








Bhattacharyya et al, Ex. 


1-2 


16 x (3,1,1) 


1 


2 


Bhattacharyya et al, Ex. 


2-1 


8 x (2,1,1) 





1 


Bhattacharyya et al, Ex. 


2-2 


8 x (2,1,1) 


1 


1 


Blondel et al. 




4 x (1, 1, 1) 


1 





Bredemann, Ex 4.2 




3 x (3,1,1) 


2 


2 


Bredemann, Ex 5.5 




3 x (2,1,1) 


3 


1 


Bredemann, Ex 5.6 




3 x (2, 1, 1) 


5 





Bredemann, Ex 5.7 




3 x (1,1,1) 


1 





Cao-Sun 




3 x (2, 1, 1) 








Chen et al. 




O X (^Z, O, L) 


D 


n 
u 


H And"\rci gt rtl H v \ 

r .-i\Li<xy d (Xi., 




80 x C3 1 1) 


4 


o 


F.-Anaya et al., Ex.2 




3 x (3,1,1) 


6 


1 


F.-Anaya et ai, Ex.3 




4 x (4,1,1) 


3 


1 


F.-Anaya et ai, Ex.4 




5 x (3,1,1) 


3 





Giinde§-Kabuli 




5 x (10,2,2) 


4 


1 


Henrion et ai, Ex. 




3 x (1,1,1) 


1 





Henrion et al, 2 nd Ex. 




3 x (1,1,1) 


1 





Jia-Ackermann 




3 x (1,1,1) 


3 


1 



Table 1: Benchmarks on simultaneous stabilization: 11 industrial and 20 academic exam- 
ples. The third and fourth columns show the lowest stabilizing controller orders in the 
literature and the lowest found by HIFOO. 

Our benchmark results are given in Tabled! showing the problem name, dimensions (with 
n max = max{tf}), the lowest known controller order from the literature (third column), 
and the controller orders obtained by HIFOO (final column). For each controller order, 
HIFOO was run 10 times; the best results are reported. Runs for order k with k > 1 were 
initialized with the best controller found for order k — 1. We used options. fast = 
(the default) but all runs were repeated with options. fast = 1, for which the results 
were almost the same. 



The performance of hifoo is very good considering the large variety and number of 
benchmark examples, hifoo successfully solves the simultaneous stabilization problems 
with a low- order single controller compared to the existing methods in the literature. 
Note that contrary to the other methods in the literature, hifoo allows the user to set 
the controller order a priori. 

In particular, hifoo is very successful in application problems, hifoo performs better 
than existing methods for the application benchmarks Lane-Keeping of Automated Vehi- 
cles and Helicopter Toy. The Rationalized Helicopter Model (RHM14) shows the conser- 
vativeness of some of the methods in the literature, which produce a 26th order stabilizing 
controller. In contrast, hifoo stabilizes the same benchmark by a static controller. 

hifoo shows similar performance for academic test problems. For almost all problems, 
the results are better than or equivalent to the results of existing methods. Some of these 
are Bredemann Ex.5. 6, Chen et al, F.-Anaya et al. Ex.1 and Ex.2, and Giinde§-Kabuli, 
for all of which the existing methods stabilize the benchmark problem with a high-order 
controller and hifoo solves the same problem by a static or first-order controller. 

There are two benchmark examples for which HIFOO performs slightly worse than the 
existing methods, namely Ex. 1-1 and 2-1 from Bhattacharyya et al. which are interval 
plants. HIFOO stabilizes both benchmark problems with a controller whose order is one 
more than the order of the controllers in the literature. 

5.2 Scenario 2: Simultaneous Optimization 

We start with two academic benchmark problems for simultaneous Tioo optimization as 
shown in Table [2j In the first problem, there are two plants of order two, with optimal full- 
order performance (using different second-order controllers) equal to 1.290 and 1.245 
respectively, hifoo finds a single first-order controller with the same Ti^ performance (as 
measured by the maximum of the norms of the two closed loop plants). Also, hifoo finds 
a static controller with performance 1.530. The previously best known Ti^ performance 
using a single controller was 1.806, using a fourth-order controller. 

The second problem consists of three plants of order two with respective optimal 
norms 1.290, 1.245 and 1.038 using full-order controllers. In the literature a 6th order si- 
multaneously stabilizing controller is known, with Ti^ performance 1.833. hifoo achieves 
the optimal 7ioo performance with a single first-order controller. 

Table [3] extends the benchmarks for simultaneous stabilization in Table [T] to Ti^ perfor- 
mance optimization. Performance channels are added to each plant in Table [1] using the 
augw function in the Control System Toolbox by 

G{k} = augw(P{k},tf (1, [1 1]),[],0.2); 

where the weighting functions are Wx(s) = and H^s) = 0.2. The dimensions of the 
plant P i are A* G W ll + 1 ^ l +\ D\ 2 G M? p * xm \ D\ x G R P2Xm2 . 
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Problem Name N x (n max , m 2 ,P2) Known HIFOO 
Cao-Lam 1, Ex 2 2 x (2,1,1) (4, 1.806)(1, 1.290) 

(0,1.530) 

Cao-Lam 2 3 x (2,1,1) (6, 1.833)(1, 1.290) 
(0,1.530) 



Table 2: Benchmarks on simultaneous H,^ optimization: two academic examples. The 
third and fourth columns show the controller order and the minimum value found for the 
maximum of the Hoo norms of the closed loop plants, in the literature and by HIFOO. 

These results clearly demonstrate that HIFOO is very effective over various types of bench- 
mark examples including industrial application and academic test problems. 

HIFOO 2.0 is available under the GNU Public License at 
www. cs .nyu. edu/overton/sof tware/hif oo 

Further information on references for the benchmark problems and other methods will be 
provided in a technical report that will be made available at this website. 

In conclusion, HIFOO, by allowing the designer to specify the controller order, is a useful 
tool for simultaneous stabilization and simultaneous Ti^ optimization. 
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CRJ-200 Aircraft 


(2,2.218), 


(1, 9.333), 


(0,41.612) 


1 — ^ a 1 — i 1 — ^ • 1 i A • Pi 

F4E Fighter Aircraft 


(2,2.993) 


, (1,3.065), 


(0,6.272) 


Gas Turbine Engine 


(2, 1.000) 


, (1, 1.000), 


(0, 1.009) 


Helicopter Toy 


(3,0.668) 


, (2,0.845), 


(1, 1.079) 


Lane-Keeping of AV 


{&, 0.916) 


, (2, 0.947), 


(1, 0.964) 


Oblique Wing Aircraft 


^z, U.4oo J 


, (1, U.oooJ, 


in n n kc\\ 

{v, u.yby ) 


rr 1 U 


(o 1 noi "\ 
(^z, 1.UZ1 ) 


, ^1, l.UZZ J, 


^U, 1 .Uz / J 


rurllV114 


yZ, U.oZO J 


, (i, u.o < 4j , 


^U, U.oO ( ) 


Servomotor 


[o, U.ZUZ J 


, ^z, u.zuz J, 


^i, u.Z4y j 


Ship-Steering 


/o 1 noo\ 
(^Z, l.UZo J 


/i i nqq\ 

, (1, l.UooJ, 


(^U, 1.U41 J 


Stirred-Tank Reactor 


^z, o.yoy ), 


^i, o.yoo ), 


IC\ KO 001 "\ 

^u, oz.yzi j 


Arehart-Wolovich 


(3,2.823) 


, (2,2.823), 


(1,2.917) 


Bhattacharyya et al, Ex. 1 


-1 (2,1.000) 


, (1, 1.000), 


(0, 1.000) 


T — ^ i ji i j 7 "l — i -t 

Bhattacharyya et al, Ex. 1 


-2 (4,2.236), 


(3,2.535), 


(2, 16.441) 


Bhattacharyya et al, Ex. 2 


-1 (3,0.202) 


, (2,0.203), 


(1,0.204) 


Bhattacharyya et al, Ex. 2 


-2 (3,3.725) 


, (2,3.739), 


(1, 3.745) 


Blondel et al. 


(2, 3.053) 


, (1,3.053), 


(0,3.053) 


Bredemann, Ex 4.2 


(4, 1.623) 


, (3, 1.736), 


(2, 1.772) 


Bredemann, Ex 5.5 


(3, 1.515) 


, (2, 1.522), 


(1, 1.682) 


Bredemann, Ex 5.6 


(2,31.613), 


(1,31.613) 


, (0,31.613) 


Bredemann, Ex 5.7 


(2, 1.073) 


, (1, 1.173), 


(0, 7.517) 


Cao-Sun 


(2, 0.201) 


, (1,0.202), 


(0,0.202) 


onen ei ai. 


yz, u.oyo ) 


(~\ n 87^ 


^U, l.UUU ) 


P -Anava pi nl F.v 1 


(2 200^ 


n n 2oo"i 


(0 n 200^ 


F.-Anaya et al., Ex.2 


(3,0.256) 


, (2,0.256), 


(1,0.256) 


F.-Anaya et al., Ex.3 


(3,1.000) 


, (2,1.000), 


(1,1.000) 


F.-Anaya et al., Ex.4 


(2,0.201) 


, (1,0.203), 


(0,0.203) 


Giinde§-Kabuli 


(3,1.000) 


, (2,1.000), 


(1,1.000) 


Henrion et al, 1 st Ex. 


(2,0.7155; 


, (1,0.759) 


, (0,1.059) 


Henrion et al, 2 nd Ex. 


(2,3.044) 


, (1,3.044), 


(0,3.455) 


Jia-Ackermann 


(3,2.556), 


(2,3.080), 


(1,13.594) 



Table 3: Benchmarks on simultaneous Hoc optimization: 11 industrial and 20 academic 
examples. The second column shows the lowest three stabilizing controller orders found 
by hifoo and the corresponding maximum of the Hoo norms of the closed loop plants. 
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